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ABSTRACT 


Much  has  been  written  on  the  theoretical  description  of  error  correcting 
codes  but,  due  to  a  lack  of  actual  channel  error  patterns,  little  has  been  said 
of  practical  performance.  In  this  paper  the  performance  of  three  types  of  error 
control  is  evaluated  for  the  case  of  independent  random  errors  and  for  an  actual 
channel  exhibiting  dense  bursts.  The  selected  codes  are  burst  codes  with  high 
probabilities  of  error  detection  and  correction. 


TABLE  OF  CONTENTS 


Page 

LIST  OF  ILLUSTRATIONS  vi 

SECTION  I  INTRODUCTION  1 

SECTION  H  HYBRID  ERROR  CONTROL  SYSTEM  2 

GENERAL  DESCRIPTION  2 

The  Hybrid  Retransmission  Technique  3 

Block  Numbering  Techniques  4 

Need  for  Retransmission  Data  Link  5 

CODE  DESCRIPTION  6 

Delay  Time  of  Codes  14 

Specialization  to  Retransmission  and 

Forward  Error  Control  14 

SECTION  m  PERFORMANCE  IN  A  MEMORY- LESS  BINARY 

SYMMETRIC  CHANNEL  (BSC)  16 

RETRANSMISSION  ERROR  CONTROL  20 

FORWARD  ERROR  CORRECTION  22 

SECTION  IV  PERFORMANCE  IN  REAL  CHANNELS  27 

FORWARD  ERROR  CONTROL  27 

RETRANSMISSION  ERROR  CONTROL  30 

HYBRID  ERROR  CONTROL  35 

SECTION  V  CONCLUSIONS  39 

APPENDIX  I  41 

DEFINITION  47 

REFERENCES  53 

BIBLIOGRAPHY  55 


v 


LIST  OF  ILLUSTRATIONS 


Figure  No.  Page 

1  Probability  of  Undetected  Error  versus  Code  Rate 

for  P^  Symbol  Codes  11 

2  Probability  of  Undetected  Error  versus  Code  Rate 

for  P^  Symbol  Codes  12 

3  Efficiency  versus  Information  Transmitted  for  a 

Hybrid  Coding  System  as  a  Function  of  Bit  Error 
Probability  21 

4  Efficiency  versus  Block  Length  as  a  Function  of 

BER  in  a  BSC  23 

5  Symbol  Improvement  Factor  versus  Probability 

of  Symbol  Error  25 

6  Symbol  Error  Probability  versus  Bit  Error 

Probability  26 

7  Percentage  of  Errors  Corrected  versus  Code  Rate  28 

8  Percentage  of  Errors  Corrected  versus  Code  Rate  29 

9  Average  Efficiency  of  Retransmission  System  on 

Troposcatter  Data  32 

10  Number  of  Retransmissions  Required  33 

11  Fixed  Block  Efficiency  31 

12  Fixed  Block  Retransmission  Performance  34 

13  Average  Efficiency  of  Hybrid  System  on  Tropo¬ 
scatter  Data  36 

14  Percentage  of  Blocks  Corrected  by  P^  Code  in 

Hybrid  System  on  Troposcatter  37 

15  Average  Number  of  Retransmissions  by  Hybrid 

System  On  Troposcatter  Data  38 

16  Full  Duplex  Communication  Circuit  Configuration  42 

17  Frequency  of  Consecutive  Error  Occurrence  44 

18  Distribution  of  Gaps  Between  Errors  45 


vi 


Figure  No. 

19 


LIST  OF  ILLUSTRATIONS  (Concluded) 


Page 

Message  Error  Rate  versus  Message  Size  46 

20  Distribution  of  Lengths  of  Bursts  49 

21  Distribution  of  Burst  Error  Densities  50 

22  Distribution  of  Lengths  of  Intervals  51 

23  Distribution  of  Interval  Error  Densities  52 


SECTION  I 


INTRODUCTION 

In  recent  years,  work  in  the  areas  of  coding  through  block,  retransmission, 

and  hybrid  techniques  was  reported  in  the  literature.  Due  to  a  lack  of  real  channel 
h  2l 

data  ’  ,  the  investigation  of  how  these  techniques  perform  in  real  channel  en¬ 

vironments  is  still  unknown.  However,  the  MITRE  Corporation  has  collected 

extensive  error  pattern  data  at  high  speeds  in  real  channel  environments  such 

r3  4  5  61 

as  IIF  and  troposcatter  (Appendix  1)  ’  .  It  is  the  purpose  of  this  paper 

to  describe  and  compare  the  performance  of  techniques  for  hybrid  error  control, 
forward  error  control,  and  retransmission  error  control  in  a  real  channel  en¬ 
vironment  and  to  contrast  this  performance  with  that  which  may  be  expected  in  a 
channel  exhibiting  independent  errors. 

Error  control  methods  are  needed  in  the  transmission  of  digital  data  if  the 
error  rate  without  control  is  unacceptable.  An  example  of  such  a  situation  is 
computer-to-computer  communications.  Not  only  is  nearly-perfect  transmission 
required  in  the  transmission  of  data,  but  error-free  transmission  is  mandatory 
when  computer  programs  are  transmitted.  The  method  of  error  control  described 
in  this  paper  will  enable  the  user  to  select  the  probability  with  which  errors  in 
the  received  message  are  acceptable  and  then  to  transmit  the  information  with 
the  highest  possible  efficiency  available  for  the  combination  of  modulation  tech¬ 
nique,  data  rate,  and  environment  in  which  the  transmission  will  take  place. 
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SECTION  II 


HYBRID  ERROR  CONTROL  SYSTEM 
GENERAL  DESCRIPTION 

Hybrid  error  control  is  the  combination  of  a  forward  error  correcting 
code  (e.g.  ,  block  code)  with  the  use  of  retransmission  error  control.  As  a 
combination  of  two  coding  procedures,  hybrid  error  control  exhibits  the  advan¬ 
tages  of  both  and  the  disadvantages  of  neither.  Specifically,  in  a  random  error 
environment,  the  forward  error  correcting  code  will  provide  error  correction 
within  the  code  block  and  retransmission  will  eliminate  any  residual  errors.  In 
a  high  density  burst*  error  environment,  the  retransmission  will  be  used  for 
error  correction  while  the  forward  error  control  eliminates  the  errors  in  the 
intervals  between  bursts.  If  the  burst  error  density  increases  to  an  extremely 
high  level  and  the  bursts  get  excessively  long,  or  if  random  errors  occur  with 
a  bit  error  rate  higher  than  a  threshold  (percentage  of  correctable  error  bits) 
derived  from  the  code,  the  system  enters  continuous  retransmission  and  will 
fail.  In  failure,  the  code  corrects  an  insufficient  number  of  errors  and  burst 
length  exceeds  the  block  length,  causing  continuous  retransmission.  However, 
since  the  codes  will  be  chosen  from  a  family,  the  code  power  can  be  increased 
to  ward  off  failure. 

The  hybrid  error  control  system  described  herein  is  a  combination  of 
retransmission  and  random  burst  symbol  error  correcting  codes,  operated  as 
a  continuous  system.  The  system  will  be  described  initially  in  terms  of  retrans¬ 
mission  with  a  code,  and  the  specific  properties  of  the  selected  code  will  be 
identified  later.  Finally,  the  hybrid  system  will  be  specialized  to  forward  error 
correction  alone  and  retransmission  alone. 


*See  Appendix  I  for  definition  of  error  pattern  parameters. 
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The  Hybrid  Retransmission  Technique 


The  hybrid  error  control  system  operates  according  to  the  following  trans¬ 
mission  procedure.  Data  is  collected  at  some  data  center  in  large  amounts.  This 
data  is  encoded  with  an  error  detecting  code  and  then  encoded  with  an  error  cor¬ 
recting  code.  The  information  is  now  transmitted  in  blocks  to  a  receiver  site 
where  the  process  of  error  correction  is  activated.  After  error  correction,  a 
final  detection  is  made  for  residual  errors.  If  there  are  no  errors,  the  data  is 
transferred  to  the  data  sink.  If  there  are  errors,  the  block  identification  number 
is  recorded  for  future  use  by  the  retransmission  system  and  the  block  is  rejected. 
During  the  finite  time  that  it  takes  to  decode  one  block  of  information,  the  next 
block  is  being  transmitted.  If  transmission  were  interrupted  for  retransmission 
of  rejected  blocks,  the  finite  delay  would  cause  a  system  slowdown.  Thus,  re¬ 
transmission  requests  transmitted  back  to  the  data  source  initiate  block  regenera¬ 
tion  at  the  conclusion  of  the  initial  transmission.  The  only  case  in  wrhich  there  can 
be  delay  time  between  blocks  is  if  the  last  block  must  be  retransmitted. 

The  above  technique  can  be  used  for  transmission  of  non-real -time  informa¬ 
tion  such  as  computer  programs  or  large  amounts  of  data  to  be  used  as  pre-flight 
and  post-flight  information  in  space  vehicle  launches.  If  near -real -time  transfer 
is  required,  a  request  for  retransmission  can  be  initiated  immediately  and  the 
block  (rejected)  in  question  will  be  regenerated  and  retransmitted  following  the 
block  in  transmission  when  the  request  is  made.  Actual  real-time  operation 
cannot  be  achieved  with  this  system. 

The  performance  of  such  a  hybrid  system  is  described  by  the  following 
transmission  efficiency  equation: 


Transmission  efficiency  (E)  - 


Transmission  efficiency  (E)  = 


Information  to  be  transmitted  (sec) 

Total  time  of  operation  (sec) 

I 


(1) 
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where 


I 


R 


d 


information  to  be  transmitted  (seconds)  =  Data  (bits)/Data  Rate 

(Bits/Scc) 

error  detection  redundancy  =  ratio  of  detection  parity  to  infor¬ 
mation  bits 


R  =  error  correction  redundancy  =  ratio  of  correction  parity  to 
detection  parity  and  information  bits. 

I  =  information  rejected  (Sec) 

-  delay  time  (Sec)  -  error  control  delay  (1  +  messages  transmitted) 
(Sec)  for  interrupted  systems 


II  the  system  operates  as  a  continuous  system  (as  will  be  the  case  in  this 
paper), 

-  error  control  delay. 

If  there  are  no  retransmissions, 


E 


1  +  lld  +  V  +  UT 


(2) 


since  I  =0. 

In  the  case  where  D^,  is  negligible  compared  to  I  and  there  are  no  retrans¬ 


missions  , 


E 


1  +  R  +  R 
d  c 


=  rate  of  the  hybrid  code. 


(2) 


II  D  is  zero  or  if  D  <  <  I,  the  efficiency  is  independent  of  I  and  of  the  data  rate. 
T  T  1 

of  the 


Thus,  it  is  possible  to  consider  the  efficiency  as  the  effective  rate  " 
hybrid  system.  The  effective  rate  is  always  less  than  the  code  rate 
ness  of  E  to  the  code  rate  acts  as  a  system  performance  criterion. 


Block  Numbering  Techniques 

Although  it  was  previously  stated  that  the  block  number  is  recorded,  it  is 
not  necessary,  in  the  case  of  block  rejection,  to  transmit  block  numbers  if  a 
powerful  synchronization  technique  is  used.  Since  every  block  has  the  same 
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number  of  bits  and  the  receiving  computer  knows  the  sequence  in  advance  (i.e. , 
sequence  is  1,  2,  . . . ,  n),  the  computer  can  assign  these  numbers.  Similarly 
in  retransmission,  since  all  retransmission  blocks  are  placed  together  at  the 
end  of  the  message,  the  computer  can  take  advantage  of  its  prior  knowledge. 

The  only  exception  is  if  there  is  a  delay  between  blocks,  in  which  case  a  delay 
message  must  be  sent  to  prevent  confusion  of  the  receiving  computer  by  the 
random  channel  output,  or  if  the  near-real -time  mode  is  used.  In  the  latter 
mode,  the  retransmitted  block  may  occur  immediately  after  the  block  in  the 
channel  or  one  block  later  if  the  regeneration  time  is  not  sufficient. 

Need  for  Retransmission  Data  Link 

It  might  appear  that  the  need  for  a  retransmission  link  would  reduce  the 
efficiency  of  the  system.  This  is  only  partially  true.  If  a  link  must  be  set  up, 
a  narrow  bandwidth  will  be  required  since  there  is  little  information  to  trans¬ 
mit.  It  is  much  more  likely  that  the  return  link  already  exists  due  to  a  need 
for  communication  in  two  directions.  The  retransmission  requests  can  be 
time-division  multiplexed  with  the  messages  of  other  users  on  the  return 
link  and,  with  careful  allocation  of  communication  availability,  there  would 
be  no  hardship  on  the  regular  users.  This  paper  will  consider  efficiency  on 
the  basis  of  the  data  link  only  assuming  return  link  availability.  Further¬ 
more  the  retransmission  requests  can  be  low  rate  coded  to  protect  against  errors. 

Specialization  to  Retransmission  Error  Control 

In  a  system  where  there  is  retransmission  error  control  only,  two  modifi¬ 
cations  need  to  be  made  to  the  hybrid  error  control  system.  The  obvious  one  is 
that  the  error  correction  redundancy  is  removed.  Thus  in  the  transmission  ef¬ 
ficiency  equation,  =  0. 

The  other  modification  to  both  the  system  and  the  transmission  efficiency 
equation  is  with  respect  to  delay.  In  the  initial  hybrid  system,  delay  is  due  to 
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the  use  of  error  correction  and  spacing  between  blocks.  With  the  error  correcting 
code  eliminated  (R  =0),  the  part  of  the  delay  due  to  the  error  correction  is 
likewise  eliminated. 

CODE  DESCRIPTION 

The  codes  which  will  be  used  are  from  a  class  of  pm  symbol  error  correcting 
[  7] 

codes.  These  codes  have  been  selected  because  of  their  high  error  correcting 
capability  for  little  redundancy  and  because  of  their  high  residual  error  detecting 
capability.  These  capabilities  are  such  that  the  codes  will  be  used  for  both  R^ 
and  R^  simultaneously,  thus  simplifying  the  efficiency  equation.  The  codes  are 
referred  to  as  (q,  n,  e)  codes,  where  q  is  the  number  of  symbols  in  the  alphabet 
expressible  as  pm,  n  is  the  number  of  symbols  in  a  code  block,  and  e  is  the  number 
of  symbol  errors  that  can  be  corrected  in  a  code  block.  The  number  p  may  be  any 
prime  power,  (p  =  2,  3,  5,  7  . . .  ,  m  =  1,  2,  3,  4,  .  . .),  and  n  is  any  positive  in¬ 
teger  not  divisible  by  p.  For  the  binary  case,  p  -  2  and  q  =  2m.  Thus  the  alphabet 
used  by  the  code  consists  of  the  set  of  binary  m -tuples.  It  is  convenient  in  this 
binary  subfamily  of  codes  to  select  n  =  2m-l.  The  correction  of  e  symbol  errors 
then  requires  that  2e  (2e<  n)  check  symbols  be  included  in  the  block. 

The  codes  are  random  symbol  error  correctmg  codes.  Within  a  block  of  n 
symbols,  e  symbols  are  correctable  if  there  are  at  most  e  symbol  errors  in  the 
block.  With  respect  to  bit  errors,  the  codes  are  burst  codes  since  if  there  is 
one  bit  error  in  a  symbol,  it  is  corrected,  but  the  code  would  be  more  efficient 
if  there  were  m  bit  errors  in  a  symbol.  As  an  example  if  m  =  3,  n  =  7,  and 
e  =  2,  then  any  two  random  bit  errors  in  the  21-bit  block  are  corrected  by  the 
code.  But  the  code  will  also  correct  two  solid  bursts  of  three  errors  in  the  block 
or  one  solid  burst  of  six  errors  (which  exists  in  two  adjacent  symbols). 

The  parameter  values  which  will  be  given  special  interest  in  this  paper  are: 
m  (bits  per  symbol)  =  8 

n  (symbols  per  block)  =  255 
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m-  n 

(bits  per  bloek) 

= 

2040 

e 

(eorreetable  symbols) 

= 

0  to  32 

2e 

(eheek  symbols  per  bloek) 

= 

0  to  G4 

n-2e 

(information  symbols  per  bloek) 

- 

255  to  191 

n-2e 

(eode  rate) 

= 

1.  0  to  0.  75 

n 


In  the  encoding  and  decoding  proeess,  the  m  bit  symbols  of  a  message  are 
treated  as  elements  of  a  finite  field.  When  dealing  with  binary  m  bit  symbols,  the 
finite  field  may  be  considered  to  eonsist  of  all  possible  m-tuples  or  m  bit  numbers. 
A  speeial  m  bit  arithmetrie  is  used  sueh  that  all  arithmetic  operations  between 
elements  of  the  field  yield  results  whieh  are  also  m  bit  numbers  and  therefore  con¬ 
tained  in  the  field.  Also,  it  may  be  stated  that  all  non-zero  members  of  the  field 
may  be  represented  by  a  speeial  number,  o,  raised  to  power  i,  where  i  ean  vary 
from  zero  to  2m-2.  The  number  a  is  referred  to  as  a  primitive  element  of  the 
field.  Addition  is  performed  modulo-two  with  no  earry.  Multiplication  in  finite 
field  arithmetic  is  analogous  to  conventional  multiplication  in  that  numbers  raised 
to  a  power  may  be  multiplied  by  adding  their  exponents.  Thus,  for  example,  a % 

times  o  equals  a  .  The  addition  of  exponents  when  multiplying  is  performed 

m  1 4  2  o 

modulo  2  -1.  Thus,  in  the  field  with  m=4,  O'  x  <y  would  equal  o'  sinee  17 


modulo  15  is  equal  to  2. 

The  equation  below  defines  a  relationship  whieh  is  true  for  all  valid  messages 
or  eode  bloeks. 


where 


ij  = 


0, 


j  =  0,  1,  2. . .  2e  -  1 


f  Vi 

B.  =  the  iL  message  symbol 
m  =  bits  per  message  symbol 
o'  =  primitive  elements  of  finite  field 

e  =  number  of  symbols  whieh  ean  be  eorreeted. 


(4) 
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According  to  Equation  (4),  the  summation  of  the  products  of  all  message  symbols 
multiplied  by  a  *1  is  equal  to  zero  where  i  specifics  the  order  of  a  symbol  in  the 
message  and  j  takes  on  all  integer  values  from  0  to  2e-l. 

To  describe  the  encoding  and  decoding  operations,  a  simple  example  in 
which  m  3,  n  =  7,  and  e  2  is  considered.  For  these  parameters,  a  message 
or  code  block  consists  of  seven  3-bit  symbols.  Since  e  2,  there  will  be  four 
cheek  symbols  in  each  block,  and  the  remaining  three  symbols  are  information 
symbols.  The  problem  in  encoding  is:  given  three  information  symbols,  to 
B9  ,  compute  the  four  cheek  symbols,  Bo  to  B(.  .  From  Equation  (4),  four  simul¬ 
taneous  equations  corresponding  to  the  four  values  of  j  can  be  written; 


j  =  0: 

;  Bo 

+  Bi  +  B2 

...  +  Bg 

0 

j  =  i; 

:  Bo 

4-  B^  a  +■  B0  a2 

...  *Bry' 

-  0 

j  =  2; 

:  Bo 

4-  B^  a2  4~  B9  oi^ 

^  ^  12 
...  +  Bg a 

=  0 

j  =  3; 

Bo 

4-  B^  cr*  +-  B2  ot  ^ 

...  +Br«18 

-  0 

Solution  of  the  four  simultaneous  equations  above  gives  the  required  cheek 
symbols,  B(^  to  B(  . 

Now  consider  the  problem  of  decoding  8,  9,  10,  11,  12,  13]  qqie  re_ 
eeived  message  symbols  are  called  Bf where  each  B-*,  consists  of  the  original 
message  symbol  B.  added  (modulo  two)  to  an  error  symbol  which  may  or  may 
not  be  zero.  The  first  step  of  the  decoding  procedure  is  to  compute  2e  numbers 
called  syndromes,  Sj  ,  in  accordance  with  Equation  (5). 

m 

2  -2 

S  ^2  j  =  °>  •••  .20-1  (5) 

i  =  0 


Substituting  Bj  =  +  V.,  we  obtain 


m 

2  -2 


2m-2 


Sj  =  BjofJ  ♦  V,,‘l 


i  =  0 


i  =  0 


Since,  from  Equation  (4) 


2  -2 

E 

i  =  0 


B.  axJ  =  0, 


2m-2 


sj  -  E  \ 


ai  j 


i  =  0 


(5a) 


(6) 


If  no  errors  have  occurred,  the  Vj_  are  all  zero  and  the  syndromes  will  also 
be  zero.  Hence,  if  the  syndromes  are  found  to  be  all  zeros,  the  message  is 
assumed  to  have  been  received  error-free.  If  one  or  more  non-zero  syndromes 
are  obtained  however,  errors  are  known  to  have  occurred  and  the  message  must 
be  corrected.  If  we  assume  that  two  errors  had  occurred  in  our  sample  message, 
they  could  be  determined  from  the  following  equations 


S0  =  vi  +  v2 


1  -i  l  9 

V.a  1  +  V2a  2 


S2  =  V 


2ii  2i9 

1  +  2 


(6a) 


3i.  3i9 

V  a  1  +  V  a  2 
1  z 


ll  19 

The  four  unknowns  in  these  equations  are  ,  V2,  a  ,  and  a  ,  where 
and  are  the  two  error  symbols,  and  i^  and  i9  correspond  to  their  locations 

in  the  message.  After  solving  for  the  error  values  and  their  locations,  the  syn¬ 
dromes  are  adjusted  for  the  errors  tentatively  assumed  to  have  occurred.  If 
the  syndromes  are  now  equal  to  zero,  it  is  decided  that  the  assumed  errors  did 
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in  fact  occur  and  the  message  is  corrected  accordingly.  If  any  of  the  adjusted 
syndromes  are  non-zero,  however,  the  message  is  considered  to  be  uncorrect- 
able  due  to  excessive  errors. 

It  was  stated  that  if  the  syndromes  are  zero  the  code  assumes  the  mes¬ 
sage  to  be  error-free  or  corrected.  There  is,  of  course,  a  possibility  that 
the  code  has  failed  to  detect  an  error.  In  this  case,  no  retransmission  will 
be  requested  in  a  hybrid  system  and  the  errors  will  be  passed  on.  In  Figures 
1  and  2  the  probability  of  an  undetected  error  is  presented  for  various  codes. 
The  curves  arc  based  on  the  derivation  resulting  in  Equation  (10).  For  pur¬ 
pose  of  this  derivation,  the  following  terms  are  defined. 

m  =  number  of  bits/ symbol 

n  =  number  of  symbols/block 

k  =  number  of  information  symbols/block 

e  =  maximum  number  of  errors  that  can  be  corrected. 

This  class  of  codes  fails  to  detect  a  block  in  error  if,  and  only  if,  the 
received  code  vector  is  no  greater  than  distance  e  away  from  some  code  vector 

other  than  the  one  sent.  Thus,  assuming  all  n-symbol  error  vectors  are 
equally  likely,  and  that  an  error  has  occurred,  the  probability  of  an  erroneous 
block  going  undetected  (and  thus  also  being  erroneously  "corrected ,r)  is 

Number  of  error  vectors  of  distance  ^e  from  a  non-zero  code  vector 
-  (7) 

Number  of  error  vectors  not  of  distance  ^e  from  the  zero  vector 

where  the  correct  vector  is  used  as  a  zero  reference. 

Number  of  ways  a  symbol  can  be  non-zero  =  2m  -1  =  n 


Number  of  vectors  with  i  non-zero  symbols 


Number  of  non-zero  code  vectors 
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Figure  I. 


Probability  of  Undetected  Error  versus  Code  Rate  for  P  Symbol 
Codes 
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Figure  2.  Probability  of  Undetected  Error  versus  Code  Rate  for  P  Symbol 
Codes 
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Number  of  vectors  of  distance  ^  e  from  a  non-zero  code  vector  = 


(8) 


Number  of  vectors  of  distance  >  e  from  the  zero  vector  =  2nm 


ni  (9) 


P  {undetected  error  J 


(10) 


The  next  section  contains  a  description  of  a  case  with  an  actual  error 
distribution  which  shall  be  taken  into  account  in  lowering  the  bound  on  the 
probability  of  an  undetected  error. 

The  curves  demonstrate  the  performance  of  the  code  in  failing  to  detect 
errors  as  a  function  of  code  rate  for  2  ^  m  ^  8.  The  case  m  =  1  can  be  considered 
as  the  trival  code  where  there  is  one  bit/symbol  and  one  symbol/block  and  the 
failure  probability  is  obviously  1  since  there  is  no  redundancy. 

Unlike  many  other  codes,  a  bursty  channel  will  not  reduce  the  performance 
of  these  codes.  Since  the  code  corrects  only  symbols,  it  does  not  matter  whether 
or  not  one  or  all  bits  in  the  symbol  are  in  error.  The  bit  error  correction  capa¬ 
bility  is,  in  fact,  better  if  all  the  bits  in  a  symbol  are  in  error.  As  an  example, 
if  m  =  8  and  the  code  rate  is  3/4,  32  symbols  can  be  corrected.  If  these  error 
symbols  are  consecutive,  the  code  can  correct  256  consecutive  errors.  If  the 
bursts  are  excessively  long,  m  must  be  increased. 

When  used  in  conjunction  with  the  efficiency  curves  in  later  sections, 

Figures  1  and  2  will  serve  to  give  the  maximum  efficiency  available  for  a 

*This  gives  a  worst  case  bound  on  P  (undetected  block  error  given  a  symbol 
error).  An  alternative  approach  to  this  calculation  is  presented  by  Mitchell/^] 
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combination  of  environment,  code,  data  rate,  length  of  information  message, 
and  probability  of  acceptable  undetected  errors. 

Delay  Time  of  Codes 

One  of  the  penalties  of  error  correction  is  the  delay  introduced  into  the 
system  by  parity  check  coding.  To  evaluate  the  delay,  the  three  places  in  which 
delay  can  occur  (i.e.,  encoding,  transmission,  and  decoding)  arc  considered. 

In  encoding,  as  the  information  bits  are  made  available  by  the  source, 
they  are  used  in  starting  the  calculation  of  check  symbols  and  "outputed”  to 
the  modem.  When  the  last  information  bit  is  ’’outputed”,  all  check  bits  are  now 
immediately  available.  Thus,  there  is  no  delay  in  encoding  as  long  as  the  coder 
can  process  bits  at  a  rate  higher  than  the  channel  data  rate. 

In  decoding,  calculations  cannot  start  until  all  symbols  are  available. 

Thus,  there  is  a  delay  of  one  block  in  transmission.  For  available  hardware, 
calculations  in  decoding  require  one  block  time  at  most.  Thus,  the  overall 
delay  due  to  coding  for  continuous  data  transmission  is  twice  the  block  length. 

If  the  blocks  were  sent  in  a  spaced  discontinuous  system,  the  delay  due  to 
coding  would  be  twice  the  block  length  per  transmitted  block.  If  such  a 
system  were  used,  this  delay  could  dominate  the  denominator  of  the  efficiency 
expression,  Equation  (1),  thus  drastically  reducing  the  efficiency.  Since  an 
actual  system  could  have  various  delays  up  to  twice  the  block  length,  wc  will 
assume  a  worst  case  in  our  performance  analysis  and  use  the  maximum  value 
of  delay  in  all  cases. 

Specialization  to  Retransmission  and  Forward  Error  Control 

In  the  case  of  l'etransmission  error  control,  the  same  codes  will  be  used 
for  error  detection  only.  Since  there  is  no  correction,  more  blocks  will  be 
retransmitted  and  the  system  efficiency  will  be  poorer.  While  this  result  is 
obvious,  it  is  still  instructive  to  sec  the  difference. 
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In  contrast  to  the  hybrid  and  retransmission  approaches  where,  for  a 
given  probability  of  undetected  error,  the  maximum  efficiency  is  achieved, 
in  forward  error  correction  the  efficiency  expression  reduces  to 


E  = 


I 


I  (1  +  R) 


1  +  R 


(11) 


which  is  a  constant.  The  penalty  caused  by  this  apparent  constant  efficiency 
is  that  some  percentage  of  the  errors  will  be  neither  detected  nor  corrected. 
If  some  errors  are  acceptable,  this  trade-off  of  errors  versus  code  rate 
may  also  be  acceptable. 
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SECTION  III 


PERFORMANCE  IN  A  MEMORY-LESS  BINARY  SYMMETRIC  CHANNEL  (BSC) 

In  this  section,  the  efficiency  relation  previously  presented  [Equation  (1)] 
will  be  evaluated  in  the  binary  symmetric  memory-less  channel. 

As  a  brief  review,  a  binary  symmetric  memory-less  channel  is  a  two-state 
channel  in  which  the  probability  of  a  transition  from  one  state  to  the  other  is 
given  as  p^,  and  the  probability  of  remaining  in  the  same  state  is  1-p^,  indepen¬ 
dent  of  past  results.  Thus,  the  probability  of  an  error  is  p^,  independent  of  the 
nature  of  the  input  to  the  channel.  As  an  example,  if  the  message  101011  was 
transmitted,  the  probability  is  p^  that  any  bit  may  be  inverted  independent  of 
what  happened  to  any  other  bit. 

Treating  the  hybrid  system  first  and  starting  with  the  efficiency  expression 


I(l  +  B)  +IR  (1  +R)  +Dt 

it  is  desired  to  find  E  versus  I.  If  I,  and  II  are  given,  it  is  first  necessary 

to  find  I^  (1  +  R)  which  equals  the  rejected  messages.  The  probability  of  reject¬ 
ing  a  message  is  equal  to  the  number  of  rejected  messages  divided  by  the  total 
number  of  messages  transmitted.  A  message  will  only  be  rejected  and  thus  re¬ 
transmitted  if  a  symbol  error  is  detected  in  it.  Error  detection  operations  are 
performed  after  all  possible  corrections.  Thus,  the  probability  of  rejecting  a 
message  is  numerically  identical  to  the  probability  of  detecting  a  symbol  error 
(if  no  error  is  detected,  the  message  is  either  properly  corrected  or  erroneously 
corrected).  If  the  same  assumptions  are  made  as  were  made  in  the  calculation  of 
P  |  undetected  block  error  j  for  the  code,  it  is  found  that 

P  |  detection  }  =  P  j  the  block  is  not  erroneously  corrected  and 

an  un-correctable  error  pattern  exists  J 

The  calculation  is  best  initiated  by  finding 

P  {at  least  e  +  1  symbol  errors  in  a  block)  . 
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n 

P  |  at  least  e  +  1  symbol  errors  in  a  block  }  =  ^  ^  P  |  i  symbol  (13) 

i  =  e  + 1 

errors  in  a  block) 

n  e 

^  ^  P  |  i  symbol  errors  in  a  block  }  =  1  -  ^  ^  P  |  i  symbol  errors  (14) 
i  =  e  + 1  i=0 

in  a  block  } 

Given  n  symbols,  the  probability  that  i  symbols  are  in  error  is  pl(l  -  p)11"-1 
where  p  is  the  probability  of  a  symbol  error.  These  i  symbols  can  be  positioned 
in  any  of  ^  j  ways. 


Thus  P  |  i  symbol  errors  in  a  block  }  ={  Ip  (1  -  p) 


-(> 


vn-i 


(15) 


The  probability  that  a  symbol  is  in  error  is  the  probability  of  at  least  one  bit 
error  in  the  symbol.  Thus 


p  =  1  -  (1  -  Pj) 


L 


(16) 


Where  p^  is  the  probability  that  a  bit  is  in  error  and  L  is  the  length  of  the 
symbol  in  bits. 

For  the  codes  selected 

L  =  m 


n  =  2m  -  1 


H51 

Thus,  (following  Mitchell  ) 
P  {  correction  failure  } 
n 


= 1  -  Z  M  , 


2m-l' 


i  (2m-l)-i 

[(1  -  (1  -Pl)m]  [(1  -p/1] 


(17) 


i  =  0 


17 


F(i)  =  Fraction  of  i  symbol  error  patterns  in  2m-l  code  symbols  which  are  cor¬ 
rectable. 

F  (i)  =  1  0  <  i  <e 

F(i)<l  e<i^n 

For  e  <  i  —  n 


JLQl 


F(i) 


where [  lis  the  total  number  of  i  symbol  error  patterns  in  n  symbols.  N(i)  is 
a  /  n 

the  number  of  such  patterns  that  are  correctable.  The  portion  of  ^  ^  N(i)  for 

i  =  0 

i  ^e  is  known  (i.  e. ,  all  patterns).  However,  only  some  patterns  are  correctable 
for  i  >  e  and  these  patterns  are  a  function  of  the  code,  channel,  and  the  decoding 
[151 

scheme  L  '  .  Thus,  we  shall  be  conservative  and  calculate  the  probability  of  de¬ 
tection  by  setting  F(i)  =  1  all  0  <  i  ^e  and  F(i)  =0  for  e  <  i  ^n  (the  guaranteed 
correction).  This  is  a  reasonable  approach,  since  the  error  is  small  . 

The  first  portion  of  Equation  (12)  is  now  available. 


,  m  . 


m„ 


P  { Detection  f  =  1  -  ^  ["  ^1  [1  -  <1  -  px)  ]  [(1-p^'"] 

i  =  0  '  1  ' 

-  P  |  undetected  error  \ 


(2m-l)-i 


(18) 


To  find  the  probability  of  an  undetected  block  error  in  a  channel  exhibiting 

[  2  ] 

independent  errors,  we  follow  the  method  used  by  Nesenbergs  .  Errors  will 
be  undetected  if  some  code  vector  is  transformed  by  the  channel  into  a  vector 
which  is  less  than  i  symbols  from  some  other  code  vector.  The  probability  of 
combinations  falling  into  this  class  is 


P  = 


-  Z  p"(1 


i) 


(19) 


i  =  e  + 1 
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where  Pn(i)  is  the  probability  of  i  symbol  errors  in  an  n  symbol  sequence. 
For  independent  errors  this  is 


P  = 


n  n 

i  =  e  + 1  '  ' 


(1  -  P) 


n-i 


2m  -1  /  m 


E 


2  -1 


i-a-P^i  [(i  -  Pl)m] 


m 

(2  -l)-i 


(20) 


i  =  e  + 1 


Using  the  previously  derived  expression  where  an  error  is  always  assumed  to 
occur,  we  find 


P  |  undetected  block  error  } 


(21) 


This  value  is  less  than  the  worst-case  bound  since,  from  the  binomial  theorem, 
P  <  1.  Thus  in  a  binary  symmetric  channel,  the  probability  of  undetected  block 
errors  is  less  than  as  given  previously. 

P  {detection}  =  P  {retransmission}  =  messages  retransmitted  (22) 

total  messages 


P  { retransmission  } 


JR  (1  +  R> 

1(1  +  R)  +  yi  +  R) 


I 


R 


I  ’  P  {  retransmission},  I  •  P  {  detection  } 
I  -  P  {  retransmission}  I  -  P  {  detection  } 


R 


I  +  I 


R 


(23) 


(24) 
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Using  this  formula,  it  is  now  possible  to  find  E  versus  I  for  various  values 
of  D^,  p^,  and  R  (where  R  implies  specific  code).  This  operation  has  been  per¬ 
formed  and  is  presented  in  Figure  3  for  m  =  8  and  e  =  32  for  a  range  of  values 
p_  is  taken  as  3.  5  sec  which  corresponds  to  two  blocks  at  1200  bits/sec. 

The  performance  of  the  system  is  a  monotonically  increasing  function  of  I,  ex¬ 
cept  where  the  probability  of  correction  is  zero,  such  that  P  j  retransmission  J 
is  one  and  the  system  breaks  down  in  both  correction  and  retransmission.  On 

the  curves  shown,  the  efficiency  reaches  0.  7  out  of  a  maximum  value  of  0.  75  for 

_2 

a  35  sec  message  where  the  probability  of  a  bit  error  is  1  x  10  .  There  is 

_2 

significant  degradation  for  a  bit  error  probability  of  1.  6  x  10  ,  but  this  simply 

means  that  a  lower  effective  rate  is  being  achieved.  This  could  be  improved  by 
going  to  a  code  rate  less  than  0.  75  but  greater  than  0.  4,  or  increasing  m. 


RETRANSMISSION  ERROR  CONTROL 


The  expression  for  efficiency  in  retransmission  error  control  is 

I 


E  = 


i  (i +  Rd) +  iR  (1  +  Rd)  +  DT 


If  it  is  assumed  that  all  errors  are  detected  and  retransmissions  occur  for  every 

detection,  it  is  again  found  that 

_  <  )  message  retransmitted 

P  \  retransmission  \  =  - ■  f  , - 

\  S  total  messages 

and  I  =  I  *  P  { retransmission}  _  I  -  P  {detection  f 

I  -  P  {  retransmission}  I  -  P  |detection| 

Since  all  errors  are  detected 

P  |  detection  }  =  P  j  occurrence  of  a  block  error  j  =  1-(1  -  p^)^  (25) 


Thus 


LR 


[1  “  (1  -  Px)  ]  I 


(1  -P  !)‘ 


(26) 


20 


21 


Figure  3.  Efficiency  versus  Information  Transmitted  for  a  Hybrid  Coding 
System  as  a  Function  of  Bit  Error  Probability 


The  same  set  of  eodes  will  be  used  and,  after  finding  the  efficiency,  the  answer 
should  have  appended  to  it  the  probability  of  an  undetected  block  error  as  derived 
for  the  BSC.  In  this  ease,  L  is  the  block  length. 

,  m  v 
L  =  m  (2  -1) 

Drp  was  taken  as  two  bloeks  in  hybrid  coding  but,  as  previously  explained,  Drp 
is  only  one  bloek  in  retransmission.  From  the  efficiency  expression  and  the 

expressions  for  1^  ,  it  is  found  that  when  is  negligible  with  respeet  to  I, 


E 


_ 1 

d+R)(l+[l.'(l-P1)L]  /(l-P,)L) 


c  - 

1  +  R 


(27) 


From  this  expression  it  is  found  that,  for  a  given  value  of  L,  as  p^  approaches 
zero  the  effieieney  approaches  the  code  rate.  Similarly  for  a  given  p^  ,  the 
efficiency  goes  to  zero  with  increasing  L.  These  results  are  presented  in 
Figure  4  along  with  the  results  for  104  ms.  delay. 

FORWARD  ERROR  CORRECTION 

Using  forward  error  eorreetion  only  in  the  independent  error  environment 
the  following  relationship  is  found  (assuming  guaranteed  eorreetion  only). 

P  |  correction  j  =  P  j  not  more  than  e  symbol  errors  in  a  block  j 
e 

■  E 

i  =  0 


'2  -IN 


[1-(1-Pi)m]  [(l-p^™] 


(2m-l)-i 


(28) 
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Figure  4.  Efficiency  versus  Block  Length  as  a  Function  of  BER  in  a  BSC 
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Using  m  =  3,  4,  5,  6,  7,  8,  and  code  rates  (2e  <  n),  a  set  of  curves  can  be  de¬ 
veloped  for  the  percent  of  errors  corrected  as  a  function  of  channel  bit  error 
rate.  However,  the  curves  will  lie  on  the  vertical  axis  between  99  and  99.  9999 

o 

percent  of  the  errors  corrected  for  all  values  of  p-^  <  10  .  Therefore,  the  re¬ 

sults  will  be  presented  as  improvement  factor  (ratio  of  input  errors  to  output 
errors)  as  a  function  of  symbol  error  probability.  A  block  is  in  error  after 
decoding  if  there  are  at  least  e  +  1  symbol  errors  in  the  block  and  a  false  cor¬ 
rection  is  not  made.  Since  this  adjustment  is  not  made,  the  results  should  be 
weighted  in  the  light  of  the  undetected  error  probabilities. 

The  results  in  Figure  5  give  the  improvement  factor  as  a  function  of  symbol 
error  probability. 

The  curves  relating  symbol  error  probability  to  bit  error  probability  are 
given  in  Figure  6.  To  convert  the  symbol  improvement  factors  which  result 
from  Figure  5  to  bit  improvement  factors,  the  following  relations  should  be 
used. 

symbol  improvement  factor  =  expected  number  of  symbol  errors 

input/number  of  symbol  errors  output 


and 


p  =  p  symbol 


=  1  -  (1-p  bit)m  . 


(29) 


(30) 


24 


Figure  5. 


Symbol  Improvement  Factor  versus  Probability  of  Symbol  Error 
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Figure  6.  Symbol  Error  Probability  versus  Bit  Error  Probability 
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SECTION  IV 


PERFORMANCE  IN  REAL  CHANNELS 

In  this  section,  the  performance  of  the  three  coding  systems  in  a 
troposeatter  environment  is  examined.  The  overall  distributions  of  the  errors 
measured  in  the  environment  is  described  in  Appendix  I  along  with  a  statement 
of  the  modulation  technique.  The  error  data  was  collected  in  90-minute  test 
samples.  A  system  which  performs  error  control  functions  was  simulated 
on  an  IBM  7030  computer  and  was  operated  for  each  90-minute  data  sample. 

The  computer  program  used  in  this  analysis  performs  all  the  functions  of 
hybrid  error  control  in  terms  of  actual  message  structure  and  the  decoding 
and  correction  of  errors.  However,  since  the  locations  of  errors  are  known 
in  advance,  if  the  program  determines  that  there  is  an  excessive  number  of 
symbol  errors  in  a  block,  no  attempt  to  correct  is  made  and  detection  is  as¬ 
sumed.  Thus,  undetected  errors  are  not  allowed  for,  and  the  results  must  be 
used  in  conjunction  with  the  probability  of  an  undetected  error  to  get  a  true 
picture. 

FORWARD  ERROR  CONTROL 

The  function  of  forward  error  correction  was  performed  by  taking  all 

data  at  a  given  data  rate  and  correcting  as  a  whole.  Thus  the  results  presented 

in  Figures  7  and  8  indicate  the  percent  of  errors  corrected  as  a  function  of 

code  rate  (n-2e)  for  all  (2e<n)  acceptable  code  rates  for  the  total  mass  of  data 
n 

at  the  given  transmission  rate.  The  results  presented  are  for  m  =  2,  3,  4, 

5,  6,  7,  and  8  for  both  the  bit  error  correction  and  block  error  correction. 

The  power  of  the  code  is  seen  to  increase  as  a  function  of  m.  Thus  it  is  possible 
to  reduce  the  redundancy  necessary  for  a  given  amount  of  error  correction 
by  increasing  m.  The  burst  structure  of  the  data  indicated  in  the  data  descrip¬ 
tion  is  even  more  evident  in  terms  of  the  code  correction  curves.  If  for  the 
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Figure  7.  Percentage  of  Errors  Corrected  versus  Code  Rate 
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Figure  8.  Percentage  of  Errors  Corrected  versus  Code  Rate 
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2400  bit/sec  data  we  consider  the  curve  for  m  =  4  at  a  code  rate  of  0.  2,  70 
pereent  of  the  blocks  in  error  are  corrected  but  only  20  percent  of  the  bit  errors 
are  eorreeted.  Thus  at  this  block  size  of  60  bits,  30  percent  of  the  blocks  with 
errors  contain  80  percent  of  the  errors.  As  m  changes  in  value,  the  block 
structure  changes,  and  the  fact  that  the  code  for  m  =  7  did  poorer  than  that 
for  m  =  6  in  a  portion  at  the  range  of  codes  for  the  1200  bit/scc  data  should  not 
be  surprising.  At  both  data  rates,  the  pattern  is  broken  for  m  =  8.  Here  the 
code  bloek  becomes  substantially  longer  than  the  bursts  and  with  respect  to 
the  code  the  data  appears  as  random  bursts,  which  is  the  mode  of  greatest 
efficiency.  The  curves  indicate  that  the  codes  do  poorly  as  forward  bit  error 
correcting  codes.  However,  the  codes  perform  excellently  as  message  error 
correcting  codes  and  can  be  used  in  the  hybrid  system  since  error  correction 
significantly  reduces  the  number  of  retransmissions  necessary  in  a  hybrid 
system.  The  2400  bit/ second  data  has  bursts  which  are  of  approximately  the 
same  length  as  the  1200  bit/sec  data  but  are  more  than  twice  as  dense  (see 
Appendix  I).  For  the  small  values  of  m,  this  difference  in  density  shows  up  in 
error  correction  performance;  for  large  values  of  m  the  differences  is  not  so 
great.  However,  it  should  be  noted  that  for  a  2040  bit  block  (m=8),  57  percent 
of  the  errors  are  contained  in  one  percent  of  the  blocks.  Based  on  these  results 
and  the  excellent  undetected  error  performance  for  m=8,  this  value  lias  been 
chosen  for  use  in  error  detection  for  the  retransmission  system  and  correc¬ 
tion  and  detection  in  the  hybrid  system. 

RETRANSMISSION  ERROR  CONTROL 

The  performance  of  retransmission  error  control  in  the  real  channel  is 
presented  in  two  ways.  The  first  is  efficiency  versus  information  transferred, 
and  the  second  is  efficiency  versus  block  length. 

The  results  for  efficiency  versus  information  transferred  were  obtained 

by  attempting  to  transfer  the  given  amount  of  information  through  each  90- 

minute  test  sample  and  calculating  the  efficiency  for  each  test  sample.  The 
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results  are  the  average  across  all  the  samples  to  obtain  the  average  efficiency, 
and  are  used  to  predict  the  expected  efficiency  of  transfer  of  large  masses  of 
data  by  retransmission  error  control  only.  The  results  are  presented  in 
Figures  9  and  10.  The  block  lengths  of  2040  bits  and  the  redundancy  levels 
have  been  chosen  so  that  there  can  be  easy  comparison  with  the  hybrid  system 
which  will  use  the  most  powerful  correction  (m^).  In  retransmission  control, 
the  symbol  codes  are  used  for  detection  only,  as  previously  described,  and 
also  the  results  must  be  used  in  combination  with  the  undetected  error  proba¬ 
bilities  of  the  code.  The  return  link  was  coded  with  m  =  10  using  one 
information  symbol. 

For  comparison  with  the  efficiency  versus  block  length  results  presented 
for  the  BSC,  a  similar  set  of  results  have  been  obtained  for  the  real  channel 
for  10  minutes  of  information  (Figures  11  and  12). 
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Figure  9.  Average  Efficiencyof  Retransmission  System  on  Troposcatter 
Data 
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Figure  10.  Number  of  Retransmissions  Required 
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Figure  II.  Fixed  Block  Efficiency 
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Figure  12.  Fixed  Block  Retransmission  Performance 
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HYBRID  ERROR  CONTROL 


Using  a  combination  of  retransmission  error  control  and  error  correction 
(m=8),  the  efficiency  in  the  hybrid  mode  as  a  function  of  information  transmitted 
has  been  obtained  (Figures  13,  14,  and  15).  Figure  13  indicates  the  average 
efficiency  as  a  function  of  I  for  various  code  rates  and  data  speeds  in  the  tropo- 
scatter  channel.  The  curves  indicate  both  the  maximum  effective  rate  which  can 
be  achieved  for  a  value  of  I  and  the  data  rate  as  a  function  of  the  acceptable 
probability  of  undetected  error.  As  before,  the  curves  must  be  read  in  conjunc¬ 
tion  with  Figures  1  and  2.  For  code  rates  other  than  those  used,  interpolation 
can  be  performed.  Figure  14  shows  the  percent  of  blocks  in  error  which  are 
corrected  by  the  error  correcting  code.  The  dip  starting  at  five  minutes  in  the 
2400  bit/sec  curves  is  due  to  an  abnormal  burst  of  three  million  bits  duration 
in  one  of  the  data  runs.  At  first  it  was  considered  that  this  burst  be  eliminated 
from  the  data  sample.  However,  on  the  basis  of  performance  of  the  system, 
this  burst  was  left  in.  The  code  failed  to  correct  the  errors  but  the  retrans¬ 
mission  part  of  the  system  compensated,  with  the  result  that  the  efficiency 
curves  show  no  degradation  for  the  range  1=5  to  1=20.  The  average  number  of 
retransmissions  is  presented  in  Figure  15.  The  previously  mentioned  low  rate 
coding  with  m  =  10  was  used  on  the  return  link.  The  important  conclusion  from 
this  data  is  that  in  the  actual  channel  (as  in  the  BSC)  it  is  possible  to  operate 
at  an  effective  rate  arbitrarily  close  to  the  code  rate  and  transfer  large  masses 
of  data  for  a  given,  acceptable  probability  of  error. 
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Figure  13. 


Average  Efficiency  of  Hybrid  System  on  Troposcatter  Data 
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Figure  14.  Percentage  of  Blocks  Corrected  by  P  Code  in  Hybrid  System 
on  Troposcatter  Data 
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Figure  15.  Average  Number  of  Retransmissions  by  Hybrid  Syste 
Troposcatter  Data 


SECTION  V 


CONCLUSIONS 

A  method  has  been  developed  to  provide  combined  error  correction  and 
retransmission  in  such  a  manner  that  the  highest  possible  rate  of  data  transfer 
can  be  achieved  for  a  given  set  of  conditions.  The  performance  of  the  system 
in  a  binary  symmetric  mcmory-less  channel  and  a  real  channel  has  been  de¬ 
scribed.  It  is  demonstrated  that,  for  a  sufficiently  long  message,  it  is  possible 
to  operate  at  an  efficiency  that  differs  only  slightly  from  the  code  rate  for  some 
value  of  acceptable  error  probability.  Unlike  many  other  systems,  this 
system  can  be  realized  with  present- state-of-the-art  hardware  and  should 
prove  useful  in  providing  reliable  digital  communication  between  any  two 
remote  geographical  locations. 
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APPENDIX  I 


In  the  spring  of  1966,  data  transmission  tests  were  eondueted  by  The 
MITRE  Corporation  on  a  U.  S.  Air  Foree  data  eireuit  (see  Figure  16).  The 
link  is  characterized  as  having  three  types  of  transmission  media:  troposcatter, 
mierowave,  and  wireline.  The  troposeatter  is  multiple-hop,  and  the  wireline 
consists  of  the  interconnection  of  numerous  leased  telephone  wirelines.  The 
dominant  sub-path  is  a  troposcatter-hop  of  over  500  miles.  During  the  tests, 
Rixon  Sebit  24B  vestigial  sideband  AM  modems  were  used  at  data  rates  of  1200 
and  2400  bit/ see  in  a  3  kHz  ehannel  whieh  was  FM  multiplexed  with  other  channels 

in  transmission.  A  total  of  38  hours  of  1200  bit/see  and  61  hours  of  2400  bit/ sec 

8  8 

data  was  collected  for  a  total  of  1.  67  x  10  and  5.  20  x  10  bits  respectively,  in 
90-minute  samples. 

The  error  pattern  data  was  obtained  by  one-way  transmission  of  a  52- 
bit  digital  data  test  pattern  which  was  compared  with  a  loeally-generated  test 
pattern  at  the  receiving  end.  When  there  was  agreement  between  the  two,  a 
logieal  zeros  were  declared  and  when  the  bits  were  different,  a  logical  one  was 
declared.  The  zeros  and  ones  were  recorded  on  magnetic  tape.  These  magnetic 
tapes  were  then  processed  through  a  tape-to-tape  converter  facility  to  produce 
an  IBM-eompatible  tape  for  processing  in  an  IBM  7030  computer  in  order  to 
determine  the  statistics  of  these  bit-by-bit  error  patterns. 

The  data  for  the  two  transmission  rates  was  processed  for  four  types  of 
statistics:  the  occurrence  of  eonsecutivc  errors,  the  occurence  of  intervals 
between  errors,  the  oeeurrenee  of  bursts,  and  word  error  rate  information. 

The  extent  of  the  data  analyzed  was  as  follows: 

Table  1-1 

Data  Rate,  bits/ see  Modem  Total  Bits 

1200  Sebit  24B  1.67  x  108 

2400  Sebit  24B  5.2xlo" 
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Average  Error  Rate  ( p  ) 

1.39  x  10“4 
3.95  x  10~4 
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Figure  16.  Full  Duplex  Communication  Circuit  Configuration 


The  relative  frequency  of  consecutive  errors  is  presented  in  Figure  17  for  the 
two  data  rates.  The  Figure  indicates  that  the  relative  occurrence  of  multiple 
errors  for  the  Troposcatter  data  is  independent  of  the  data  rate  for  these  two 
rates.  Further,  the  relative  occurrence  is  certainly  not  of  an  independent 
random  nature  since,  if  it  were,  over  98  percent  of  the  errors  would  occur  as 
single  errors  while  in  fact  only  70  percent  occur  as  single  errors. 

This  lack  of  independence  is  further  illustrated  in  Figure  18  where  the 
cummulative  frequency  at  occurrence  of  error-free  gaps  is  presented. 

All  these  curves  confirm  that  this  error  pattern  data  is  widely  different 
from  independent  random  errors  at  the  same  error  rate.  The  cummulative 
distribution  of  error-free  gaps  for  independent  random  curves  is  (in  theory) 
described  by 

P  {cne|e}  =  ^  p(i  _  p)k 
k  =  0 

where 

c  represents  a  correct  bit 
e  represents  an  error  bit 
n  represents  number  of  consecutive  bits 

The  message  error  rate  (defined  as  the  occurrence  of  at  least  one  error 
in  a  message)  as  a  function  of  message  size  is  presented  in  Figure  19  for  these 
two  classes  of  data. 

It  is  interesting  to  note  that  the  value  of  pmfor  n  =  2000  in  the  actual  data 
is  independent  of  error  rate  and  signaling  speed.  This  again  indicates  that  the 
errors  are  occurring  in  bursts  and,  while  for  the  overall  data  pe  at  2400  bits/ 
sec  is  2.  85  times  are  large  as  pe  at  1200  bits/sec,  the  additional  errors  which 
are  occurring  at  the  higher  signaling  speed  occur  as  increased  bursts  density. 
Thus  it  is  evident  that  bursts  occur  as  fades  in  time  unrelated  to  the  data  rate 
(for  the  rates  measured).  This  conclusion  is  confirmed  by  a  visual  observation 
of  the  error  patterns. 
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Figure  17.  Frequency  of  Consecutive  Error  Occurrence 
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Figure  18.  Distribution  of  Gaps  Between  Errors 
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Figure  19.  Message  Error  Rate  versus  Message  Si 


The  description  of  the  error  statistics  presented  thus  far  have  made  it 
clear  that  the  errors  fall  in  a  non-random  clump  distribution.  To  describe 
these  error  bursts  and  the  intervals  between  bursts  (guard  space)  an  additional 
statistic  shall  be  used. 

DEFINITION 

A  burst  in  defined  as  a  region  of  the  serial  data  stream  where  the  following 
properties  hold.  A  minimum  number  of  errors,  M^,  are  contained  in  the  region 
and  the  minimum  density  of  errors  in  the  region  is  A  .  Both  of  these  conditions 
must  be  satisfied  for  the  chosen  values  of  and  A  for  the  region  to  be  defined 
as  a  burst.  The  density  of  errors  is  defined  as  the  ratio  of  bits  in  error  to  the 
total  number  of  bits  in  the  region. 

The  following  properties  hold  for  the  bursts.  The  burst  always  begins 
with  a  bit  in  error  and  ends  with  a  bit  in  error.  A  burst  may  contain  correct 
bits.  Each  burst  is  immediately  preceded  and  followed  by  an  interval  in  which 
the  density  of  errors  is  less  than  A  . 

The  burst  probability  density  function  is  defined  as  the  probability  of  oc¬ 
currence  of  a  burst  of  size  N,  where  N  is  any  positive  integer.  The  burst  size 
is  measured  in  terms  of  the  total  number  of  bits  in  the  burst.  A  separate  burst 
probability  density  function  may  be  determined  for  each  pair  of  values  of  A  and 

M  . 

e 

The  minimum  number  of  errors  in  a  burst  has  been  chosen  to  be  2  for  all 
the  data  included  here. 

The  interval  is  defined  as  the  region  of  the  serial  data  stream  where 
the  following  properties  hold.  The  minimum  density  of  errors  in  less  than  A, 
and  the  region  begins  and  ends  in  a  correct  bit.  An  interval  may  contain 
errors.  An  interval  is  always  immediately  preceded  and  followed  by  a  burst. 
Thus,  each  and  every  bit  in  the  data  stream  must  lie  in  either  a  burst  region 
or  an  interval  region. 


47 


The  interval  probability  density  function  is  defined  as  the  probability  of 
occurrence  of  an  interval  of  length  L,  where  L  is  any  positive  integer.  The 
interval  probability  density  is  a  joint  function  of  both  A  and  Me. 

In  Figure  20,  the  distribution  of  observed  burst  lengths  is  presented  for 
the  data.  The  burst  lengths  range  from  2  (Mg)  to  over  1,000,000.  While  90  per¬ 
cent  are  less  than  1000  bits  long,  the  remaining  bursts  contain  most  of  the  errors. 
The  densities  of  these  bursts  are  displayed  in  Figure  21.  This  Figure  confirms 
the  previous  conclusions  that  at  2400  bits/ sec  the  additional  errors  serve  to  in¬ 
crease  the  density  of  the  bursts.  Further,  while  the  minimum  criteria  (A)  is 
chosen  at  0.  01,  over  50  percent  of  the  bursts  have  densities  greater  than  0.  1. 

A  correlation  was  performed  on  the  burst  lengths  and  their  associated  densities 
and  it  was  found  that  while  bursts  less  than  10  bits  in  length  are  generally  100 
percent  dense  (consecutive  errors)  and  bursts  over  1,000,000  bits  in  length  are 
near  the  minimum  criteria,  the  other  bursts  range  in  density  between  the  mini¬ 
mum  and  75  percent,  indicating  that  there  is  no  correlation  between  the  length 
of  bursts  and  densities.  The  value  of  A  was  chosen  such  that  values  of  burst 
lengths  and  density  are  independent  of  A . 

The  distribution  seen  on  these  curves  indicates  that  the  errors  fall  into 
adjacent  clusters  of  errors  with  long  error-free  intervals  between  clusters. 

There  are  no  intermediate  grouping  of  errors.  In  a  theoretical,  random  error 
distribution,  the  intermediate  groupings  would  predominate.  Figures  22  and  23 
show  the  distribution  of  interval  lengths  and  associated  densities.  The  important 
facts  to  note  here  are  that  over  60  percent  of  the  intervals  are  error  free  and 
that  the  remaining  intervals  have  no  more  than  one  or  two  random  errors  within 
them. 
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Figure  20.  Distribution  of  Lengths  of  Bursts 
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Figure  21.  Distribution  of  Burst  Error  Densities 
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Figure  22.  Distribution  of  Lengths  of  Intervals 
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Figure  23.  Distribution  of  Interval  Error  Densities 
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